Goto

Collaborating Authors

 ubiquitous computing


Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial

arXiv.org Artificial Intelligence

Large language models (LLMs) have become phenomenally surging, since 2018--two decades after introducing context-awareness into computing systems. Through taking into account the situations of ubiquitous devices, users and the societies, context-aware computing has enabled a wide spectrum of innovative applications, such as assisted living, location-based social network services and so on. To recognize contexts and make decisions for actions accordingly, various artificial intelligence technologies, such as Ontology and OWL, have been adopted as representations for context modeling and reasoning. Recently, with the rise of LLMs and their improved natural language understanding and reasoning capabilities, it has become feasible to model contexts using natural language and perform context reasoning by interacting with LLMs such as ChatGPT and GPT-4. In this tutorial, we demonstrate the use of texts, prompts, and autonomous agents (AutoAgents) that enable LLMs to perform context modeling and reasoning without requiring fine-tuning of the model. We organize and introduce works in the related field, and name this computing paradigm as the LLM-driven Context-aware Computing (LCaC). In the LCaC paradigm, users' requests, sensors reading data, and the command to actuators are supposed to be represented as texts. Given the text of users' request and sensor data, the AutoAgent models the context by prompting and sends to the LLM for context reasoning. LLM generates a plan of actions and responds to the AutoAgent, which later follows the action plan to foster context-awareness. To prove the concepts, we use two showcases--(1) operating a mobile z-arm in an apartment for assisted living, and (2) planning a trip and scheduling the itinerary in a context-aware and personalized manner.


FairComp: Workshop on Fairness and Robustness in Machine Learning for Ubiquitous Computing

arXiv.org Artificial Intelligence

How can we ensure that Ubiquitous Computing (UbiComp) research outcomes are both ethical and fair? While fairness in machine learning (ML) has gained traction in recent years, fairness in UbiComp remains unexplored. This workshop aims to discuss fairness in UbiComp research and its social, technical, and legal implications. From a social perspective, we will examine the relationship between fairness and UbiComp research and identify pathways to ensure that ubiquitous technologies do not cause harm or infringe on individual rights. From a technical perspective, we will initiate a discussion on data practices to develop bias mitigation approaches tailored to UbiComp research. From a legal perspective, we will examine how new policies shape our community's work and future research. We aim to foster a vibrant community centered around the topic of responsible UbiComp, while also charting a clear path for future research endeavours in this field.


Making the HoloLens 2: Advanced AI built Microsoft's vision for ubiquitous computing

#artificialintelligence

Redmond, Washington โ€“ The first time people don the new HoloLens 2 on their heads, the device automatically gets to know them: It measures everything from the precise shape of their hands to the exact distance between their eyes. The artificial intelligence research and development that enabled those capabilities "was astonishingly complicated" but essential to making the experience of using the device "instinctual," said Jamie Shotton, a partner scientist who leads the HoloLens science team in Cambridge, United Kingdom. "We want you to know how to use HoloLens without having to be taught how to use it," he said. "We know how to interact with things in the real, physical world: We pick things up, we press buttons, we point to things. We aim, as far as possible, to translate that directly into mixed reality."


Research Issues in Mining User Behavioral Rules for Context-Aware Intelligent Mobile Applications

arXiv.org Machine Learning

These devices, particularly the smart mobile phones have transformed over a period of time from merely communication tools to smart and highly personal devices enabling to assist the users in their variety of day-to-day situations in their daily life. In the real word, users' interest on "Mobile Phones" is more and more than other platforms like "Desktop Computer" or "Tablet Computer" over time [36]. People use mobile phones not only for voice communication between individuals but also for various activities such as applications (mobile apps) using, Internet browsing, emailing, using online social network, instant messaging etc [28]. Recent advances in the sensing capabilities of smart mobile phones make them enable to collect the rich contextual information and users' various activity records with mobile phones through the device logs. These historical mobile phone data are simply as the collection of the past contexts and user's activities with the mobile phones for these past contexts. These are phone call logs [39] having phone call activities, app usages logs [45] having various mobile application usages, mobile phone notification logs [22] having the responses with various notifications from different applications, web logs [13] having Internet browsing activities of the mobile phone users. The main characteristic of such kind of phone log data is that it contains the actual diverse activities of the users in different contexts in their real world life. Modeling smartphone user behaviors by developing various computational machine learning methods (rule-based learning) in order to analyze different behavioral patterns in different contexts, and eventually predict the next behaviors or detect strange behaviors utilizing such mobile phone data, can be used for build- 2 Iqbal H. Sarker*


HAR-Net:Fusing Deep Representation and Hand-crafted Features for Human Activity Recognition

arXiv.org Machine Learning

Wearable computing and context awareness are the focuses of study in the field of artificial intelligence recently. One of the most appealing as well as challenging applications is the Human Activity Recognition (HAR) utilizing smart phones. Conventional HAR based on Support Vector Machine relies on subjective manually extracted features. This approach is time and energy consuming as well as immature in prediction due to the partial view toward which features to be extracted by human. With the rise of deep learning, artificial intelligence has been making progress toward being a mature technology. This paper proposes a new approach based on deep learning and traditional feature engineering called HAR-Net to address the issue related to HAR. The study used the data collected by gyroscopes and acceleration sensors in android smart phones. The raw sensor data was put into the HAR-Net proposed. The HAR-Net fusing the hand-crafted features and high-level features extracted from convolutional network to make prediction. The performance of the proposed method was proved to be 0.9% higher than the original MC-SVM approach. The experimental results on the UCI dataset demonstrate that fusing the two kinds of features can make up for the shortage of traditional feature engineering and deep learning techniques.


University Of Washington Developing Artificial Intelligence Caretakers For Alzheimer's Sufferers

AITopics Original Links

"As my father lost the ability to do things for himself, my mother would give him gentle prompts to keep him on track," recalled Kautz, associate professor in the University of Washington's Department of Computer Science & Engineering. "So at a stage of the disease where, according to the clinical scales, it would seem he couldn't do anything for himself, he could still perform many of the functions of life. He could shower, get dressed, and so forth because my mother would monitor him and give a prompt when needed." It's a recollection that has guided Kautz in initiating a research effort at the UW to explore ways in which computer science can compensate for diminished mental capacity. The Assisted Cognition Project is a collaborative effort by the UW, Intel Computers and Elite Care, a private company developing a state-of-the-art retirement community in the Portland area that utilizes so-called ubiquitous computing to keep tabs on residents' needs.


Conversational Computing - Success @ Creative PR Blog

#artificialintelligence

One of the major announcements to come out of Microsoft's Build 2016 developer conference today was the bet the company is making on bots. Microsoft believes that bots are the new apps. Yesterday, they invited developers to build bots for Cortana, the company's virtual assistant. Cortana, for you non-gamers, is a virtual persona character from Microsoft's blockbuster first-person shooter Halo franchise. Microsoft is betting on the notion of "conversational computing," which is why the company is putting its voice recognizing virtual assistant front and center.


Scientists Connect Brain to a Basic Tablet--Paralyzed Patient Googles With Ease

#artificialintelligence

That was the year she learned to control a Nexus tablet with her brain waves, and literally took her life quality from 1980s DOS to modern era Android OS. A brunette lady in her early 50s, patient T6 suffers from amyotrophic lateral sclerosis (also known as Lou Gehrig's disease), which causes progressive motor neuron damage. Mostly paralyzed from the neck down, T6 retains her sharp wit, love for red lipstick and miraculous green thumb. What she didn't have, until recently, was the ability to communicate with the outside world. Like T6, millions of people worldwide have severe paralysis from spinal cord injury, stroke or neurodegenerative diseases, which precludes their ability to speak, write or otherwise communicate their thoughts and intentions to their loved ones.


Conversational Computing - Success @ Creative PR Blog

#artificialintelligence

One of the major announcements to come out of Microsoft's Build 2016 developer conference today was the bet the company is making on bots. Microsoft believes that bots are the new apps. Yesterday, they invited developers to build bots for Cortana, the company's virtual assistant. Cortana, for you non-gamers, is a virtual persona character from Microsoft's blockbuster first-person shooter Halo franchise. Microsoft is betting on the notion of "conversational computing," which is why the company is putting its voice recognizing virtual assistant front and center.